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Abstract —In recent works, sparse models and convex optimization 
techniques have been appUed to radio-interferometric (RI) imaging 
showing the potential to outperform state-of-the-art imaging algorithms 
in the field. In this talk, I will review our latest contributions in RI 
imaging, which leverage the versatility of convex optimization to both 
handle realistic continuous visibilities and offer a highly parallelizable 
structure paving the way to high-dimensional data scalability. Firstly, 
I will review our recently proposed average sparsity approach, SARA, 
which relies on the observation that natural images exhibit strong average 
sparsity over multiple coherent bases. Secondly, I will discuss efficient 
implementations of SARA, and sparse regularization problems in general, 
for large-scale imaging problems in a new toolbox dubbed PURIFY. 

The advent of next-generation radio telescopes, such as the new 
LOw Frequency ARray (LOFAR), the recently upgraded Karl G. 
Jansky Very Large Array (VLA) and the future Square Kilometer 
Array (SKA), has posed several challenges for image reconstruction 
and the design of data processing systems m The new telescopes 
will achieve much higher dynamic range than current instruments at 
a higher angular resolution. Also, these telescopes will acquire a 
massive amount of data, thus posing large-scale inverse problems in 
the perspective of image reconstruction. These challenges have trig¬ 
gered an intense research in the community to reformulate imaging 
and calibration techniques for radio interferometry (RI). 

The RI measurement equation can be discretized as y = 0a: -f n, 
where y € denotes the vector of measured visibilities, 0 € 
(j^Mxiv ^ discretization of the measurement operator and n € 
represents the observation noise. In m we propose an imaging 
algorithm dubbed sparsity averaging reweighted analysis (SARA) 
based on average sparsity over multiple bases, showing superior 
reconstruction qualities relative to state-of-the-art imaging methods 
in the field. A sparsity dictionary composed of a concatenation 
of q coherent bases, 0 = [0i, 02 , • • •, 0q], is used and average 
sparsity is promoted through the minimization of an analysis io prior, 
||0^a:||o, where 0^ denotes the adjoint operator of 0 1^ . 

SARA adopts a reweighted ii minimization scheme to promote 
average sparsity through the prior ||0^a:||o. The algorithm replaces 
the io norm by a weighted ii norm and solves a sequence of weighted 
ii problems where the weights are essentially the inverse of the values 
of the solution of the previous problem (21, (Sl. The weighted £i 
problem is defined as: 

min ||W0^a:||i subject to \\y — 0a:||2 < e, (1) 

where W £ ^ denotes the diagonal matrix with positive weights, 

R+ denotes the positive orthant in R^ and t is an upper bound on 
the £2 norm of the noise, which can be accurately estimated. Hence, 
we focus our attention on solving problem 0 efficiently, especially 
for large-scale data problems, i.e. when the number of visibilities 
is very large (M 1:^ N). In this case, we propose to split the data 
vector y and the measurement operator into R blocks in the following 


manner: 

y = [yf, ■ • •, vW and 0 = [0f,..., 0fl]^, (2) 

where each yi is modelled as y; = 0ia: + rii and rii denotes the 
noise vector. With this partition the optimization problem in O can 
be reformulated as 

min ||W0^a;||i subject to ||yi — 0ia:||2 < £i, i — (3) 

where each Ci is an appropriate bound for the I 2 norm of rii. 

In (4) we propose a general algorithmic framework based on the 
simultaneous-direction method of multipliers (SDMM) to solve 0. 
The proposed framework offers a parallel implementation structure 
that decomposes the original problem into several small simple 
problems, hence allowing implementation in multicore architectures 
or in computer clusters, or on graphics processing units. These 
implementations provide both flexibility in memory requirements 
and a significant gain in terms of speed, thus enabling scalabil¬ 
ity to large-scale problems. A beta version of an SDMM-based 
imaging software written in C and dubbed PURIFY was released 
that handles various sparsity priors, including SARA, thus providing 
a new powerful framework for RI imaging (toolbox available at 
http://basp-group.github.io/purify/l. Even though this beta version of 
PURIFY is not parallelized yet, we discuss in detail the extraordi¬ 
nary parallel and distributed optimization potential of SDMM to be 
exploited in future versions. We also discuss other possible research 
avenues for big data scalability. One possibility is to incorporate 
ideas from stochastic gradient methods into proximal splitting and 
augmented Lagrangian methods. The key idea is to use only one data 
block yi, or a subset of blocks, at each iteration of the reconstruction. 
By doing so, the computational complexity per iteration will be 
reduced. Thus, the total processing time of the algorithm will also be 
reduced if the convergence rate of the original problem is preserved. 
See for example (5) and references therein for first theoretical results. 
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